|
Author |
Thread Statistics | Show CCP posts - 23 post(s) |
|
CCP Explorer
C C P C C P Alliance
1836
|
Posted - 2013.11.19 09:32:00 -
[1] - Quote
CCP Paradox wrote:X
Hmm, now if I just request enough VIP time to exceed the 1 hour by a minute, we can all have a free beer from CCP Falcon! Hrrrmmmm
Erlendur S. Thorsteinsson | Development Director | EVE Online // CCP Games | @erlendur |
|
|
CCP Explorer
C C P C C P Alliance
1836
|
Posted - 2013.11.19 09:38:00 -
[2] - Quote
In order to not repeat me, here's a twitter thread: https://twitter.com/erlendur/status/402546312274792449 Erlendur S. Thorsteinsson | Development Director | EVE Online // CCP Games | @erlendur |
|
|
CCP Explorer
C C P C C P Alliance
1840
|
Posted - 2013.11.19 12:01:00 -
[3] - Quote
So, about that hour's downtime... Erlendur S. Thorsteinsson | Development Director | EVE Online // CCP Games | @erlendur |
|
|
CCP Explorer
C C P C C P Alliance
1844
|
Posted - 2013.11.19 12:59:00 -
[4] - Quote
Lady Areola Fappington wrote:CCP Explorer wrote:So, about that hour's downtime... Yeah, about that. So, got any recommendations for a good brew? Preferably something with a nice, hefty pricetag. My personal favourites are Kaldi from Bruggsmi+¦jan and the Nr-line from Borg bruggh+¦s.
Erlendur S. Thorsteinsson | Development Director | EVE Online // CCP Games | @erlendur |
|
|
CCP Explorer
C C P C C P Alliance
1845
|
Posted - 2013.11.19 22:14:00 -
[5] - Quote
Inquisitor Ageri wrote:Glasgow Dunlop wrote:for patch day? or are they laying background data in for the patch? Patch day. 11:00 - 12:00 EVE time. It'll probably run over but not by a lot. Oh we of little faith! *Edit - *expansion* day, not patch day! But that depends on how you perceive CCP's bug-fixing timeline. Actual was 11:00 - 12:20 EVE time. Pretty good I thought.
Now, my initial goal was to deploy in 24 minutes. The deployment of Trinity in 2007 was scheduled for 24 hours, actual was closer to 22 hours, then boot.ini happened Would have been symbolic 6 years later to schedule the deployment for 24 minutes and deploy in 22.
But then as we looked at the DB updates we had to add 25 minutes. Finally the teams asked for 5 minute VIP time for verification. A total of 54 minutes and we scheduled 55. During the deployment we encountered issues with the CDN we use and it took 25 minutes to resolve that with the technicians.
A grand total of 80 minutes. Still faaaar away from 22-24 hours
Since the summer of 2011 we have gotten much better at deploying expansions. Since then expansion deployments have taken:
- Crucible: 470 minutes = 7.83 hours
- Inferno: 250 minutes = 4.17 hours
- Retribution: 200 minutes = 3.33 hours
- Odyssey: 340 minutes = 5.67 hours
- Rubicon: 80 minutes = 1.33 hours
Tyrannis, on 26 May 2010, was the last one to take more than 1,000 minutes. Red Moon Rising on 16 December 2005 was the longest deployment, at 1,440 minutes or 24 hours. Erlendur S. Thorsteinsson | Development Director | EVE Online // CCP Games | @erlendur |
|
|
CCP Explorer
C C P C C P Alliance
1848
|
Posted - 2013.11.20 09:45:00 -
[6] - Quote
We have also been working on reducing the actual usage of the daily 30 minute scheduled downtime. If you look at this graph that shows the daily downtimes from July through end of October this year then we were using between 15 and 20 minutes daily even when there were no deployments. We have reduced that to 8 to 10 minutes, and with the new Cluster Load Balancer (devblog from CCP Prism X pending) then the cluster is taking 2 minutes less starting up so I'm hoping to reduce the target for non-deployment downtimes to 6-8 minutes. Will we be able to formally reduce the scheduled downtime from the current 30 minutes? I hope so, but I'm not committing to that right now. Erlendur S. Thorsteinsson | Development Director | EVE Online // CCP Games | @erlendur |
|
|
CCP Explorer
C C P C C P Alliance
1856
|
Posted - 2013.11.20 23:28:00 -
[7] - Quote
CCP Prism X wrote:Nicen Jehr wrote:Thanks for the numbers CCP Prism X and CCP Explorer! lookin forward to the devblog!
Can you tell us what is different about your dev/ops nowadays, compared to the early expansions, that makes deployments so much faster? We don't get any deployment candy now until AFTER the deployment! Quite the motivator, isn't it?
There were many parts to this; moving downtime database jobs to run online, reducing all testing to only be server-side deployment verification, improving deployment tools, processes and scheduling, improving server shutdown and startup. Erlendur S. Thorsteinsson | Development Director | EVE Online // CCP Games | @erlendur |
|
|
|
|